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(57) Abstract 

An image data processing system includes a PDA (2), an image data processing unit (3) for editing image data created by the PDA, 
and a personal computer. The above units include communication units (16, 35, 47) which can communicate with one another via a 
communication line a. The PDA includes an image input unit (12) for creating the image data of a subject, image data-related information 
creating means (20) for creating information related to the image data, and an input unit (14) for determining an output format of image 
data and the like. The image data processing unit (3) includes a data storage unit (34) for storing received image data and the like, a CPU 
(31) for editing image data based on an input of output format information, and a printer (5) for outputting the edited image data. The 
personal computer (4) includes a CPU (41) for editing received image data. 
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DESCRIPTION 

IMAGE DATA PROCESSING SYSTEM 
5 ; 

Technical Field 
The entire contents of Japanese Patent Application 
No. 8-346201 filed on December 25,/ 1996 are 
incorporated herein by reference. 
10 Background Art 

Recently, digital cameras (electronic cameras) for 
electrically storing photographed images instead of 
using films have been widely used. In such a digital 
camera, when the shutter release is depressed to issue 
15 an instruction of fetching an image of a subject, the 

image is electrically fetched by use of a solid state 
imaging device such as a CCD, the fetched image is 
compressed by the compression processing technique such 
as JPEG, and the compressed still image is stored in a 
20 solid state memory such as a flash memory. 

The digital camera has a function of permitting a 
photographed image to be recognized on the spot and is 
excellent in quick adaptability in comparison with a 
conventional camera which uses a film for photographing 
25 and in which the photographed image cannot be observed 

until it is developed and printed. 

Further, recently, a device obtained by attaching 
the above digital camera function to a device having a 
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PDA (Personal Digital Assistant) function such as a 
personal digital assistant is also commercialized and 
it is possible to transmit photographed image data to 
another place via a telephone line. 
5 However y in the digital camera with the image data 

transmitting function, the photographed data is 
transmitted to a personal computer at user's home and 
then the image data is processed by use of the personal 
computer, but since the image data processing is 

10 largely dependent on the image data processing 

capability of the personal computer, an added value of 
image data purposely photographed cannot be fully 
utilized in some cases. 

Disclosure of Invention 

15 An object of this invention is to provide an image 

data processing system capable of utilizing the 
function of transmitting photographed image data and 
permitting anybody to fully utilize the added value of 
the image data. 

20 According to a first aspect of this invention, an 

image data processing system comprises a photographing 
unit including photographing means for photographing a 
subject to create image data; and transmission means 
for transmitting the image data via a communication 

25 line; and a center unit including reception means for 

receiving image data transmitted from the photographing 
unit via the communication line; storage means for 
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storing image data received by the reception means; 

editing means for editing image data stored in the 

storage means; and output means for outputting image 

data edited by the editing means . 

According to a second aspect of this invention, an 

image data processing device comprises communication 
means for transmitting and receiving data with respect 

to a terminal unit connected to a network; storage 
means for storing image data received via the 
communication means; editing means for editing image 
data stored in the storage means; and output means for 
outputting image data edited by the editing means. 

According to this invention, the image data 
processing system receives and stores photographed 
image data from a terminal unit such as a PDA connected 
via the network. After the stored image data is edited 
according to a request, the image data is output to an 
output unit such as a printer. 

Therefore, the image data and the like created in 
the photographing unit can be edited according to an 
output format which the user desires and output in a 
preset output format, thus the output format is not 
influenced by the function of the terminal unit of the 
user unlike the conventional case, and the added value 
of photographed image data can be fully utilized. 

Further, for example, when the user makes a 
journey and if the user previously transmits 
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photographed image data and the like to a center 
(having a center unit) near the user's home and 
designates an output in a desired output format, it 
becomes possible for the user to drop in the center on 
5 the way home from the journey and take an output 

material (for example, album) home, and thus it becomes 
unnecessary for the user to edit the image data and the 
like by himself, it becomes convenient and the user can 
inmiediately see the output result. 
10 Further, since the image data and the like 

photographed by the photographing unit can be 
transmitted to the terminal unit and reedited after 
they were edited by the center unit, for example, the 
user can remove unnecessary image data, or change or 
15 add text information such as a comment or title by use 

of a terminal unit provided at his home or the like and 
he can edit the photographed image data to his 
satisfaction. 

Further, according to this invention, noted places, 
20 buildings, place names and the like are stored in 

connection with position data in a data base on the 
server side. Therefore, it becomes possible to receive 
information of position and information of azimuth 
measured by use of a GPS or azimuth sensor provided in 
25 the PDA together with photographing data and display 

information (noted place, building, place name and the 
like) associated with the photographing place based on 
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corresponding information of photographing position, 
photographing azimuth and the like by referring to the 
data base. Therefore, an album with large added value 
can be made . 

Brief Description of Drawings 
FIG. 1 is a system block diagram of an image data 
processing system according to an embodiment of this 
invention; 

FIG. 2 is a block diagram showing the construction 
of a main portion of a PDA 2; 

FIG. 3 is a block diagram showing the construction 
of a main portion of an image data processing unit 3; 

FIG. 4 is a block diagram showing the construction 
of a main portion of a personal computer 4; 

FIG. 5 is a flowchart showing the content of a 
process for photographing a subject in the PDA 2; 

FIG. 6 is a flowchart showing the content of a 
comment input process in the PDA 2; 

FIG. 7 is a flowchart showing the content of a 
data transmission process for transmitting data from 
the PDA 2 to the image data processing unit 3; 

FIG. 8 is a flowchart showing the content of an 
image data process in the image data processing unit 3; 

FIG. 9 is a flowchart showing the contents of 
communication and editing processes for image data and 
the like effected by the personal computer 4 and image 
data processing unit 3; ^ 
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FIG. 10 is a flowchart showing the content of an 
album data conununication processes effected by the 
personal computer 4 and image data processing unit 3; 

FIG. 11 is a diagram showing the memory 
5 configuration of a data storage unit 34 of the image 

data processing unit 3; 

FIG. 12 is a diagram showing the data memory 
configuration of the data storage unit 34 of the image 
data processing unit 3; 

FIGS. 13A and 13B are diagrams schematically 
showing one format of output result of image data and 
the like by an image data processing system 1; 

FIG. 14 is a system block diagram of an image 
processing unit according to another embodiment of this 

15 invention; 

FIG. 15 is a system block diagram showing a PDA 

shown in FIG. 14; 

FIG. 16 is a diagram showing the memory 
configuration of a server in the embodiment shown in 

20 FIG. 14; 

FIGS. 17 and 18 are diagrams showing the internal 
configuration of a data base shown in FIG. 14; 

FIG. 19 is a flowchart showing the reception 
process of the server in the above embodiment of this 

25 invention; 

FIG. 20 is a flowchart showing the content of a 
process which the server executes in response to 
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various requests from the PC in the above embodiment of 
this invention; 

FIG. 21 is a flowchart shdwing a process effected 
when the PC issues various requests to the server in 
the above embodiment of this invention; and 

FIGS. 22A to 22C are diagrams showing screen 
display examples of image data and related information 
thereof in the PC. 

Best Mode of Carrying Out the Invention 

There will now be described an embodiment of an 
image data processing system according to this 
invention in detail with reference to FIGS. 1 to 22C. 

First, the construction is explained. 

FIG. 1 is a system block diagram of an image data 
processing system according to an embodiment of this 
invention . 

In FIG. 1, an image data processing system 1 is 
constructed by a PDA (Personal Digital Assistant) 2 
used as a photographing unit, an image data processing 
unit 3 used as a center unit, a personal computer 4 
used as a terminal unit and the like and the above 
portions are connected via a communication line a. 
Further, a printer 5 is connected to the image data 
processing unit 3. 

FIGS. 2 and 3 are block diagrams respectively 
showing the constructions of the main portions of the 
PDA 2 and image data processing unit 3. 
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As shown in FIG, 2, the PDA 2 is constructed by a 
CPU (Central Processing Unit) 11, image input unit 12/ 
display unit 13, input unit 14, vertical/horizontal 
sensor 15/ communication unit 16, RAM (Random Access 
5 Memory) 17, ROM (Read Only Memory) 18, memory 19, timer 

20, GPS (Global Positioning System) measuring unit 21, 
counter 22 and others and the above portions are 
connected via a bus 23. 

The CPU 11 effects operation processes necessary 

10 for various operations corresponding to an input via 

the input unit 14 with respect to the RAM 17 according 
to various control programs stored in the ROM 18 and 
creates and outputs various control signals for 
controlling the respective portions of the PDA 2 based 

15 on the operation processes. 

The image input unit 12 is constructed by a CCD 
(Charge Coupled Device), lens, A/D converter, driving 
circuit, timing generator and others although they are 
not shown in the drawing, and it receives light of the 

20 image of a subject formed by the lens in the CCD, 

stores charges of an amount proportional to the amount 
of received light in each of transfer electrodes 
arranged on the light receiving surface of the CCD and 
sequentially converts the stored charges stored in each 

25 of the transfer electrodes treated as an electrical 

signal (analog signal) into digital image data for each 
electrode in response to a driving signal supplied from 
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the driving circuit in the A/D converter. 

The display unit 13 is constructed by a liquid 
crystal display panel or the like to display an image 
based on photographed image data and display the 
content of a command input from the CPU 11 or a comment 
or title input via the input unit 14 . 

Although not shown in the drawing, the input 
unit 14 is a unit for outputting a depression signal to 
the CPU 11 when a key on a keyboard having a cursor key, 
numeral input keys, various function keys and the like 
is depressed and it is used to input a title and 
comment for image data and determine the output format. 
Further, the input unit 14 may be of a so-called tablet 
type which has a transparent position detecting tablet 
superposed on a liquid crystal display (not shown) and. 
detects the XY coordinate of a pressurized point by 
contact of a finger tip based on a pressure-sensitive 
system and outputs the same to the CPU 11. 

The vertical/horizontal sensor 15 is a sensor for 
detecting whether the photograph is taken with the 
PDA 2 set in the horizontal position or in the vertical 
position and the PDA 2 has a pendulum provided therein 
to detect the position based on the rotation of the 
pendulum. 

The communication unit 16 has a function of 
executing the communication protocol for transmitting 
and receiving image data and the like with respect to 
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the image data processing unit 3 or terminal unit 4 via 
the communication line a and has a terminal which can 
be connected to the communication line a. 

The RAM 17 has a storage area for temporarily 
5 storing image data and the like and a work area for the 

CPU 1 I and data can be rewritten according to the input 
via the input unit 14. 

The ROM 18 stores various control programs 
(lor example, part of the programs shown in the 
10 flowcharts of FIGS. 5 to 7 , and FIGS. 9, 10) executed 

in the PDA 2 and data and the like used in the program 
processing • 

The memory 19 is a unit for storing photographed 
image data. The memory 19 has a storage medium 19a in 

15 which programs^ data and others are previously stored 

and the storage medium 19a is formed of a magnetic, 
optical storage medium or semiconductor memory. The 
storage medium 19a includes a medium fixedly provided 
in the memory 19 or a medium which can be removably 

20 mounted. The program, data and others to be stored in 

the storage medium 19a may be supplied from another 
device connected via the communication line and stored 
therein . 

The timer 20 has a time counting function, counts 
25 the photographing time and outputs time data to the 

CPU 11. 

The GPS (Global Positioning System) measuring 
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unit 21 has a function of measuring a place at which 
the user took a photograph of image data, specifies the 
place at which the image data was photographed based on 
a difference between the arrival times of radio waves 
transmitted to a plurality of artificial satellites 
(for example, four or more satellites) from a control 
station on the ground and the arrival times of radio 
waves transmitted from the artificial satellites to the 
PDA 2 and outputs the coordinate data of the place, 
place name and others to the CPU 11. 

Although not shown in the drawing, the counter 22 
is constructed by a counter and the like, counts the 
number of photographs taken after preset photographing 
start time and outputs the obtained result to the 
CPU 11. 

The PDA 2 transmits image data, data of time at 
which the image data was photographed, GPS data, 
vertical/horizontal data, number-of -images data, 
comment, title and a command signal of a desired output 
format to the image data processing unit 3 according to 
a transmission command by the user. 

FIG- 3 is a block diagram showing the construction 
of the main portion of the image data processing unit 3 
in the above embodiment to which this invention is 
applied. 

The image data processing unit 3 shown in FIG. 3 
has a CPU 31, RAM 32, program memory 33, data storage 
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unit 34, communication unit 35 and others provided 
therein. 

The CPU 31 fetches image data and related data 
(image data and the like) thereof stored in the data 
5 storage unit 34 and subjects the image data to the 

editing process, and stores the result of the process 
into the data storage unit 34 again or outputs the same 
to the printer 5 or the like according to various 
control programs stored in the program memory 33. 
10 The RAM 32 forms a work area used for the image 

data editing process executed by the CPU 31. 

The program memory 33 has a storage medium 33a in 
which a program (for example, a program shown in 
FIG. 8), data and others are previously stored and the 
15 storage medium is formed of a magnetic, optical storage 

medium or semiconductor memory. The storage medium 33a 
includes a medium fixedly provided in the memory 19 or 
a medium which can be removably mounted. Further, in 
order to obtain the program, data and others stored in 
20 the storage medium 33a, it is possible to provide a 

memory having the above storage medium on another 
device side connected via the communication line a and 
use the program and data stored in the storage medium 
33a via the communication line a. 
25 The data storage unit 34 is constructed by a 

format memory 34a, data memory 34b, album memory 34c 
and others as shown in FIG. 11 and image data and data 
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related to the image data transmitted from the PDA 2 or 
. image data obtained after editing and data related to 
the image data are stored therein. 

The communication unit 35 is connected to the 
PDA 2 or personal computer 4 via the communication line 
a (for example, telephone line) and has a communicating 
function of executing the communication protocol for 
transmitting and receiving image data and the like via 
the communication line a. ^ 

The image data processing unit 3 receives image 
data received from the PDA 2 and data related thereto 
or a command signal of output format at the 
communication unit 35 and stores the received image 
data and the like in the data storage unit 34. Then, 
it fetches image data and the like from the data 
storage unit 34 via the CPU 31 based on the command 
signal of output format, subjects the image data and 
the like to the editing process, and outputs the result 
of the process to the personal computer 4 or printer 5. 
Further, the image data processing unit 3 receives 
image data reedited in the personal computer 4 and 
image data-related information and stores them into the 
data storage unit 34, 

FIG. 4 is a block diagram showing the construction 
of ^ the main portion of the personal computer 4 in the 
above embodiment to which this invention is applied. 

The personal computer 4 shown in FIG. 4 is 
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constructed by a CPU 41, RAM 42, ROM 43, hard disk 44, 
keyboard 45, display unit 46, communication unit 47, 
audio output unit 48 and others. 

The CPU 41 fetches image data and image data- 
related information stored in the hard disk 44, 
subjects them to the image data editing process, and 
stores the result of the process into the hard disk 44 
again or outputs the same to the image data processing 
unit 3 according to various control programs stored in 
the ROM 43. Further, the CPU 41 also effects the 
control operation to convert the image data-related 
information into an audio signal. 

The RAM 42 forms a work area for the image data 
editing process effected by the CPU 41. 

Various control programs necessary for editing 
image data are stored in the ROM 43. 

In the hard disk 44, image data transmitted from 
the PDA 2 and data related to the image data, or image 
data obtained after editing and data related to the 
image data are stored. 

Although not shown in the drawing, the keyboard 45 
is a unit for outputting a depression signal to the 
CPU 41 when a key on a keyboard having a cursor key, 
numeral input keys, various function keys and the like 
is depressed and it is used to input a title and 
comment for image data and determine the output format. 

The display unit 46 is constructed by a CRT 
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(Cathode Ray Tube) or the like and displays an image 
display signal input via the CPU 41 in a specified 
color. 

The conununication unit 47 is connected to the 
5 PDA 2 or image data processing unit 3 via the 

communication line a (for example, telephone line) and^ 
has a communicating function of executing the 
communication protocol for transmitting or receiving 
image data via the communication line a. 
10 The audio output unit 4 8 is constructed by a 

speaker which is not shown or the like and outputs 
image data-related information which is converted into 
an audio output as a. voice. 

The personal computer 4 fetches image data edited 
15 in the image data processing unit 3 or the like via the 

communication line a by use of the communication 
unit 47, displays the fetched image data and the like 
on the display screen of the display unit 46, reedits 
the image data and the like and outputs the image data 
20 to the image data processing unit 3 again. At this 

time, the output format can also be determined. 

The printer 5 is connected to the image data 
processing unit 3 and outputs the edited image data and 
the like in a preset format. 
25 Next, the operation is explained. 

FIG. 5 is a flowchart showing the content of a 
process for photographing a subject in the PDA 2. 

BNSCXXJID: <WO 983001©A1 J_> 
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When a key of the input unit 14 which corresponds 
to the shutter release of a camera is depressed, the 
photographing process is started. In the step SI, 
image data of a photographed subject is created in the 
image input unit 12 and the image data is stored into 
the memory 19 . 

In the step S2, a process for reading the time at 
the image data creation time from the timer 20 and 
storing the time data into the memory 19 is effected. 

In the step S3, the measuring place (the 
coordinate indicating the north latitude and the east 
longitude) at the image data creation time is read from 
the GPS measuring unit 21 and the GPS data is stored 
into the memory 19. 

In the step S4, information that the photographed 
image data is a vertical type or horizontal type is 
read from the vertical/horizontal sensor 15 and the 
vertical/horizontal data is stored into the memory 19. 

In the step S5, the number of the photographed 
image data counted from the preset photographing start 
time is read from the counter 2 2 and the number-of- 
images data is stored in the memory 19, and then the 
present photographing process is completed. 

FIG. 6 is a flowchart showing the content of the 
comment input process in the PDA 2. 

In the comment input process, a process for 
reading out photographed image data from the memory 19 



wo 98/30019 



PCT/JP97/04603 



17 

is effected in the step Sll. 

In the step S12, a comment for the fetched image 
data is input by use of a keyboard (not shown) of the 
input unit 14. 

In the step S13, a category (for example, which is 
used for grouping the same type of data) according to 
the user's request for the fetched image data. 

In the step S14, a process for storing the input 
comment and category in correspondence to the readout 
image data into the memory 19 is effected and the 
present comment input process is terminated. 

FIG. 7 is a flowchart showing the content of a 
data transmission process for transmitting data from 
the PDA 2 to the image data processing unit 3 . 

The PDA 2 can transmit a photographed image and 
transmit an output request of the image to the image 
data processing unit. In the data transmission process, 
whether an output request for requesting the image data 
processing unit 3 to output data is present or not is 
determined in the step S21, and if it is detected as 
the result of the above determination that the output 
request is present, an output request signal is 
transmitted (step S23) from the communication unit 16 
of the PDA 2 to the communication unit 35 of the image 
data processing unit 3 after the output format 
designating process (step S22) is effected, and then 
the present data transmission process is terminated. 
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and if it is detected as the result of the above 
determination in the step S21 that no output request is 
present/ the step S24 is effected. 

In the step S24, whether a data transmission 
5 command is present or not is determined ^ and if it is 

detected as the result of the above determination that 
no data transmission command is present, the present 
process is returned to the step S21 and is repeated, 
and if the data transmission command is present, a 

10 process for transmitting image data specified to be 

transmitted and related data thereof from the 
communication unit 16 of the PDA 2 to the communication 
unit 35 of the image data processing unit 3 is effected 
and the present data transmission process is terminated. 

15 In this case, the output format designating 

process effected in the step S22 is a process for 
designating a way of printing the image received by and 
stored in the image data processing unit 3. More 
specifically, the output format can be previously 

20 selectively set in the time unit, place unit, 

vertical/horizontal unit, category unit, number-of- 
images unit, that is, the output selection can be made 
in the unit of related data of the image data and the 
output format can be determined by selecting one of 

25 them by the user's operation- The arrangement of an 

image with album size shown in FIG. 13 as will be 
described later is determined by designation of the 
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output format. 

Next, an image data processing on the center side 
effected in the image data processing unit 3 based on 
an output request signal or image data and the like 
output from the PDA 2 is explained with reference to 
the flowchart of FIG. 8. A program for realizing 
various functions of the center described in the 
flowchart is stored in the storage medium 33a in the 
form of program code which can be read out by the 
CPU 31. 

In the image data processing unit 3, first, 
whether image data and related data thereof transmitted 
from the PDA 2 in the step S25 of FIG- 7 are received 
by the communication unit 35 or not is determined in 
the step S31. If it is detected as the result of the 
above determination that the image data and related 
data thereof are received, the step S32 is effected to 
store the image data and related data thereof in the 
data memory 34b (for example, related data (time 51, 
place 52, comment 53, number of images 54, category 55) 
is stored in correspondence to image data 50 as shown 
in FIG. 12). If it is determined in the step S31 that 
no image data or the like is received, the step S33 is 
effected to determine whether an output request signal 
in the step S23 is received by the communication 
unit 35 or not. If the output request signal is 
received, the output format designated in the step S34 
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is stored in the format memory 34a and a printout 
(for example, the output result as shown in FIGS. 13A 
and 13B) is issued from the printer 5 in the step S35 
to terminate the process. Further, if the output 
request is not received, the step S31 is effected again 
and the process is repeated. 

Next, the flow of the process for communicating 
and editing image data and the like effected between 
the personal computer 4 and the image data processing 
unit 3 of the center is explained with reference to 
FIG. 9. 

The personal computer 4 can designate an output 
destination and issue an output request for outputting 
an image with respect to the center. First, if an 

15 output request of image data and the like is 

transmitted (step S41) from the personal computer 4 to 
the image data processing unit 3, the image data 
processing unit 3 determines in the step S42 whether 
the output request is issued for an output to the 

20 personal computer 4 or an output to the printer 5. If 

an output to the printer 5 is determined as the result 
of the above determination, the step S43 is effected to 
output the image data and the like in the designated 
format. On the other hand, in the case of an output to 

25 the PC 4, the image data and the like are edited in the 

designated output format (step S44) and the edited 
image data and the like are transmitted from the 
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communication unit 35 to the communication unit 47. of 
the personal computer 4 (step S45) . 

In the personal computer 4, image data and the 
like transmitted from the image data processing unit 3 
of tho center is received in the step S46 and the 
received image data and the like are displayed on the 
diBplay unit 46. On the display screen, the user 
ef loots the reediting process (step S47) such as 
removal of an unnecessary photograph by use of the 
keyi>oard 45. At this time, a process for converting 
text data into a voice can be specified, and if the 
specification is made, text data is converted into 
voice data and an acoustic icon is attached to the 
image instead of display of the text. 

In the step S48, a process for transmitting the 
reedited image data and the like to the image data 
processing unit 3 is effected. 

In the step S49, the image data processing unit 3 
receives the reedited image data and the like 
transmitted from the personal computer 4 at the 
communication unit 35, effects a process for storing 
the received reedited image data and the like into the 
album memory 34c in the data storage unit 34 (step S50) 
and the present image data communicating and editing 
process is terminated. 

Next, the processing flow of the album data 
communicating process effected by the image data 



wo 98/30019 



PCT/JP97/04603 



22 



processing unit 3 of the center and the personal 
computer 4 is explained with reference to FIG. 10. 

If an output request for album data or the like 
stored in the album memory 334c of the data storage 
5 unit 34 is transmitted from the personal computer 4 to 

the image data processing unit 3 (step S51), the image 
data processing unit 3 reads out album data stored in 
the album memojry 34c and transmits the same to the 
personal computer 4 via the communication unit 35 in 

10 the step S52. 

The personal computer 4 receives the album data 
transmitted from the image data processing unit 3 at 
the communication unit 47 in the step S52 and displays 
the received album data on the display unit 46 

15 (for example, on the CRT screen) (step S54). In the 

step S55, whether the acoustic icon on the display 
screen of the displayed album data is specified or not 
is determined, and if it is detected as the result of 
the above determination that the acoustic icon is not 

20 specified, the step S54 is effected to repeatedly 

display the data, and if the acoustic icon is specified, 
text data is converted into a voice and output by the 
audio output unit 48 in the step S56. 

Since the image data processing system 1 described 

25 above is formed with the above construction, the 

following image data processing can be attained, for 
example . 
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First, the user who makes a journey with the PDA 2 
takes photographs of scenery, person, or the like 
on the journey. Thus, photograph data is created in 
the image input unit 12, and at the same time, 
photographing time is determined by the timer 20, the 
photographing place is determined by the GPS measuring 
unit 21, whether the photograph is taken in the 
vertical position or in the horizontal position is 
determined by the vertical/horizontal sensor 15, the 
number of the photographed image data counted from the 
preset photographing start time is determined by the 
counter 22, and the image data and the related data 
thereof are stored in the memory 19. 

Then, the user fetches each photographed image 
data from the memory 19, displays the same on the 
display unit 13 and inputs a comment or title for the 
image data via the input unit 14. At this time, the 
user inputs a category to categorize scenery images and 
person images. Then, the image data and the related 
data thereof are transmitted to the communication 
unit 35 of a center having the image data processing 
unit 3 and existing near the user's home via the 
communication line a by use of the communication 
unit 16 . 

The image data processing unit 3 of the center 
stores the received image data and related data thereof 
in the data storage unit 34. 
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Then, the user inputs an output request for 
printing of images and the like based on the image 
data and related data thereof in time-sequential order, 
for example, via the input unit 14 and transmits the 
output request signal to the image data processing 
unit 3 of the center on the final day of the journey. 

The image data processing unit 3 of the center 
outputs cin album of images and the like based on the 
image data and the related data thereof to the printer 
5 thereof according to the received output request 
signal. More specifically, as shown in FIG. 13B, 
images (photographs) 57 are printed together with 
time 58, place 59, comment 60, title 61 and the like in 
time-sequential order as an album. 

Then, the user will drop in the center on the way 
back home from the journey and take an output album 
home . 

Therefore, the image data and the like created in 
the PDA 2 (photographing unit) can be edited according 
to the output format which the user desires and output 
in the preset output format and the added value of the 
photographed image data can be fully utilized while the 
output format is not influenced by the function of the 
personal computer 4 (terminal unit) of the user unlike 
the conventional case. 

Further, since an output in the desired output 
format can be attained by previously transmitting 
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photographed image data and the like to a center near 
the user's home, it becomes unnecessary for the user to 
edit the image data and the like by himself, it becomes 
convenient and the user can immediately see the output 
5 result. 

In this case, the personal computer at the user's 
home and the image data processing unit 3 are connected 
to each other via the communication line a. 

Therefore, the user can fetch the image data and 
10 image data-related information edited in the image data 

processing unit 3 into the personal computer 4 and 
perform the reediting process such as removal of 
unnecessary image data, re-arrangement, or addition or 
modification of the comment or title so as to edit the 
15 photographed image data to his satisfaction. 

In this case, image data and image data-related 
information subjected to the reediting process can be 
transmitted to the image data processing unit 3 again 
and output from the printer 5 • 
20 Therefore, the user can determine the output 

format by use of either the photographing unit or the 
terminal unit and it becomes a further convenient image 
data processing system. 

Further, in this case, text information such as 
25 the comment and title can be specified to be output as 

a voice by the personal computer 4 . 

Therefore, when an electronic album is reproduced 
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by use of a personal computer or the like, text 
information can be output as a voice and the image data 
editing with larger added value can be attained. 

Next, another embodiment of this invention is 
explained with reference to FIGS. 14 to 22C. 

FIG- 14 is a system block diagram of an image 
processing unit according to another embodiment of this 
invention. In FIG. 14, a personal computer (which is 
hereinafter referred to as a PC) 51, portable terminal 
unit (which is hereinafter referred to as a PDA) 53 
and server 55 are connected to one another via a 
communication network 57. A data base 59 is connected 
to the server 55. The data base 59 stores position 
information (physical information such as a 
15 geographical coordinate) and information (social 

information such as a place name) related to the 
position. 

FIG. 15 is a system block diagram of the PDA 53 
shown in FIG. 14. As shown in FIG. 15, the PDA 53 is 

20 constructed by a CPU 59, keyboard 61, photographing 

unit 63, display unit 65, GPS 67, ROM 69, RAM 71, 
communication unit 73, and azimuth sensor 75 and the 
above units are connected to one another via a system 
bus 77. Since the CPU 59, keyboard 61, photographing 

25 unit 63, display unit 65, GPS 67, ROM 69, RAM 71 and 

coiranunication unit 73 among the above units have 
constructions equivalent to those of the CPU 11, input 
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unit 14, image input unit 12, display unit 13, GPS 21, 
ROM 18, RAM 71 and communication unit 73, the 
explanation therefor is omitted. The azimuth sensor 75 
measures the azimuth when photographing is made by use 
of the photographing unit 63 (that is, a direction in 
which photographing is made) . 

FIG. 16 shows the memory configuration in the 
server 55. The memory configuration shown in FIG. 16 
has areas for storing information of azimuth and other 
information in addition to the memory configuration 
shown in FIG. 12. As the information of azimuth, 
information of azimuth measured by the azimuth sensor 
75 of the PDA 53 is stored. Further, as the other 
information, for example, an electronic mail address of 
a person whom the user came to know on the journey is 
stored by transmitting the electronic mail address from 
the PDA 53 to the server 55 after the user photographed 
him and heard his electronic mail address. As a result, 
the photographed image can be transmitted later to the 
electronic mail address. 

FIGS. 17 and 18 are diagrams showing the internal 
configuration of the data base 58 shown in FIG. 14. 
The first data base shown in FIG. 17 previously stores 
position information (information of coordinates 
measured by the GPS 67) 83 and place name information 
(such as the names of noted sightseeing resorts) 85 
corresponding to the position information. The second 
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data base shown in FIG. 18 has position information 
(information of coordinates measured by the GPS 67) 87, 
azimuth information and geographical information 91 
corresponding to the azimuth. For example, the place 
5 names of respective places existing on the north side, 

south side, west side and east side of a certain 
position coordinate (indicating the north latitude and 
the east longitude) are previously stored. 

FIG. 19 is a flowchart showing the reception 
10 process of the server. The server 55 receives image 

data and position data from the PDA 53 via the 
communication network 57 in the step S93- Then, it 
stores the received image information and position 
information into a specified area in the data base 58 
15 assigned to the sender in the step S95. 

FIG. 20 is a flowchart showing the content of a 
process which the server 55 executes in response to 
various requests from the PC 51 and FIG. 21 is a 
flowchart showing a process effected when the PC 51 
20 issues various requests to the server 55- In the step 

S117 of FIG. 21, the PC 51 transmits an output request 
of desired image data to the server 55 via the 
communication network 57 . The server 55 receives the 
image output request from the PC 51 in the step S97 of 
25 FIG. 20. Then, in the step S99, it reads out specified 

image data and related information (FIG. 16) thereof 
among the stored image data from a specified area of 
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the data base 58 which is assigned to the user in 
response to the output request and transmits the same 
to the PC 51. The PC 51 displays the image data and 
related information thereof transmitted from the server 
55 on the display unit 65 as shown in FIG. 22A in the 
step S119 of FIG. 21. The user can specify further 
related information (geographical information) of the 
image data displayed on the display unit 65 in the 
step S121. For example, in a case the user wants 
to know the name of a sightseeing resort in a 
corresponding place based on position information 
measured by the GPS 67, the user moves the cursor to a 
position corresponding to a position information field 
(133 in FIG. 22A) thereof and clicks the mouse 61. 
Alternatively, if the user wants to know the name of a 
place at which the photograph was taken based on the 
azimuth measured by the azimuth sensor 75, the user 
moves the cursor to a position corresponding to an 
azimuth field 135 shown in FIG. 22A and clicks the 
mouse. As a result, the PC 51 transmits the clicked 
position information and azimuth information to the 
server 55 in the step S123. The server 55 determines 
the content of the request from the PC 51 in the step 
SlOl of FIG. 20, searches the data base 58 to read out 
specified information (a place name corresponding to 
the position information or a place name corresponding 
to the azimuth information) in the step S109, and 
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outputs the information to the PC 51 in the. step Sill. 

The PC 51 receives place name information 
corresponding to the position information and azimuth 
information from the server 55 and displays "KOFU" and 
5 "Mt. FUJI" as shown in FIG. 22B in the step S125. 

Further, if the user wants to transmit image data 
displayed on the display unit 65 to the address of the 
electronic mail displayed as shown in FIG. 22C, he 
moves the cursor to a position corresponding to the 
10 electronic mail address and clicks the mouse so as to 

permit the PC to transmit a mail transmission request 
together with the electronic mail address to the server. 

The server determines in the step S127 of FIG. 21 
that an image data transmission request by the 
15 electronic mail is issued from the PC and transmits the 

image data to the electronic mail address in the 
step S129. 

Further, if the user wants to print image data 
displayed on the display unit 65, he clicks a print 
20 button (not shown) on the display unit 65 by use of the 

mouse in the display screen of FIG. 16 so as to permit 
the PC to transmit a print request to the server via 
the communication network 57 . 

The server 55 determines the print request from 
25 the PC in the step S127 of FIG. 21 and prints the 

specified image data in the step S131. 

Further, the user sometimes wants to input some 
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conunent for the displayed image data. In such a case, 
a comment is input by use of the keyboard unit 61 and 
the PC 51 transmits the input comment to the server 55. 
The server 55 determines the comment input request from 
5 the PC in the step S127 and writes the comment into the 

corresponding comment field 54 shown in FIG. 16 in the 
step S129. 

Related data of the image data is not limited to 
the type described in the above embodiments and may be 
10 any type of inf orrivation if it is related to the image 

data . 

Further, the preset output format includes an 
output by a printing unit, output by a display unit,, 
output by an audio unit and the like. 
15 Further, the output format is determined based on 

the related data of the image data in the above 
embodiments but may be determined based on data 
different from the related data of the image data. 
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CLAIMS 

1. An image data processing system comprising: 
a photographing unit (2) including photographing 

means (12) for photographing a subject to create image 
5 data; and transmission means (16) for transmitting the 

image data via a communication line; and 

a center unit (3) including reception means (35) 
for receiving image data transmitted from said 
photographing unit via the communication line; storage 
10 means (34) for storing image data received by said 

reception means; editing means (31) for editing image 
data stored in said storage means; and output means (5) 
for outputting image data edited by said editing means. 

2. A system according to claim 1, wherein said 
15 photographing unit further includes additional 

information creating means (20, 21) for creating 
information added to the image data, said transmission 
means includes means for transmitting the image data 
and additional information, said receiving means 

20 includes means for receiving image data and additional 

information transmitted via the coiranunication line, 
said storage means includes storing means for storing 
image data and additional information received by said 
receiving means, and said editing means includes means 

25 for editing the image data stored in said storing means 

based on the additional information. 

3. A system according to claim 2, wherein said 
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photographing unit includes designating means (11) for 
designating an output format^ and said editing means of 
said center unit includes means for editing data into a 
format designated by said designating means, 

4. A system according to claim 3^ wherein said 
additional information creating means includes at least 
one of position measuring means (21) for measuring a 
position at which the image data was photographed and 
timer means (20) for counting time at which the image 
data was photographed, and said designating means 
includes means for designating an output in the unit of 
photographing place or time. 

5. A system according to claim 3, wherein said 
additional information creating means includes means 
for inputting a category of image data and said 
designating means includes means for designating an 
output according to the category of image data- 

6. A system according to claim 3, wherein said 
center unit further includes a data base (58) which 
stores information related to additional information, 
and additional information outputting means (55) for 
fetching information related to additional information 
received from said photographing unit from said data 
base and outputting the information. 

7. A system according to claim 6, wherein said 
additional information creating means includes position 
measuring means for measuring the position at which the 
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image data was photographed, said data base includes 
means for storing a geographical name related to 
position information as a data base, and said 
additional information outputting means includes means 
5 for outputting a geographical name corresponding to a 

position when information of the position is received 
as additional information. 

8. A system according to claim 1 , wherein said 
additional information creating means further includes 

10 azimuth measuring means (75) for measuring the azimuth 

in which the image data was photographed, said data 
base further includes means for storing a geographical 
name related to a combination of the position 
information and azimuth information, and said 

15 additional information outputting means includes means 

for outputting a geographical name corresponding to a 
position and azimuth when information of the position 
and information of the azimuth are received as 
additional information . 

20 9. A system according to claim 1, wherein said 

photographing unit includes means for adding an 
electronic mail address to photographed image data, and 
said center unit includes means for transmitting the 
image data to the added electronic mail address. 

25 10. A system according to claim 1, wherein said 

outputting means includes means for outputting data to 
a terminal unit connected via a communication line (a). 



BNSDOCID: <WO 9B30019A1_L> 



wo 98/30019 



PCT/JP97/04603 



35 

11. An image data processing device comprising: 
communication means for transmitting and receiving 

data with respect to a terminal unit (53) connected to 
a network ( 57 ) ; 

5 storage means (58) for storing image data received 

via said communication means; 

editing means (55) for editing image data stored 
in said storage means; and 

output means (55) for outputting image data edited 
0 by said editing means. 

12. A device according to claim 11, wherein said 
storage means includes means for storing image data and 
additional information received via said communication 
means, and said editing means includes means for 

5 editing the image data stored in said storage means 

based on the additional information. 

13. A device according to claim 12, wherein said 
editing means includes means for editing data into a 
format designated by said terminal unit via said 

0 communication means. 

14. A device according to claim 13, wherein 
additional information stored in said storage means 
includes at least one of information of position at 
which the image data was photographed and information 

5 of time at which the image data was photographed, and 

said editing means includes means for editing data to 
output the data in the unit of photographing place or 
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15. A device according to claim 14, wherein said 
output means includes a printer (5) for printing out 
edited image data. 

5 16. A device according to claim 12, further 

comprising a data base which stores information related 
to additional information; and additional information 
outpuLMng means for fetching information related to 
the received additional information from said data base 

10 and out-putting the information. 

17. A device according to claim 16, wherein the 
additional information contains position information of 
information at which the image data is photographed, 
said data base includes means for storing a 

15 geographical name related to the position information 

as a data base, and said additional information 
outputting means includes means for outputting a 
geographical name corresponding to a position when 
information of the position is received as additional 

20 information. 

18- A device according to claim 11, wherein said 
output means includes means for outputting edited image 
data to a terminal unit connected via a network. 
19. A device according to claim 18, further 

25 comprising means for receiving image data reedited by 

the terminal unit; and means for printing out received 
image data. 
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20. A device according to claim 11, further 
comprising means for transmitting image data by 
electronic mail to a mail address when the electronic 
mail address is added to the image data. 
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